Greenleaf was born in Pennsylvania and educated at the Medical College of Ohio, graduating in 1860. During the Civil War, he oversaw construction of Philadelphia's Mower Hospital on Chestnut Hill, which was at the time the largest military hospital in the world. He introduced a system of personal identification used by the army and organized the army's Hospital Corps.